program-data-separation demo #42

lucylq · 2025-07-17T01:00:46Z

Add examples on how to generate PTE, PTD files, and how to run them in ExecuTorch via Module.

Note: I created a separate ET submodule --> we need the changes from 0.7 for this. However, I'm not sure we should be creating a new submodule for each project.

Issue: pytorch/executorch#12215

lucylq · 2025-07-17T21:39:27Z

.gitmodules

@@ -2,3 +2,8 @@
 	path = mv2/cpp/executorch
 	url = https://github.com/pytorch/executorch.git
 	branch = release/0.6
+
+[submodule "program-data-separation/cpp/executorch"]


Should we have ET as a submodule for each project, though?

Note: we don't have a release for 0.7, once we do we could potentially update and consolidate the two submodules?

yeah, eventually we could just have a common submodule directory

for now, don't worry about it

mergennachin

See inline

mergennachin · 2025-07-18T13:55:38Z

program-data-separation/README.md

+# Program Data Separation Examples
+
+This directory provides an example of the Program Data Separation APIs in ExecuTorch.
+


Give some motivation and high-level context of what and why

mergennachin · 2025-07-18T13:56:52Z

program-data-separation/README.md

+```
+Or alternatively, [install conda on your machine](https://conda.io/projects/conda/en/latest/user-guide/install/index.html)
+```bash
+conda create -yn executorch-examples-mv2 python=3.10.0 && conda activate executorch-examples-mv2


use a different conda env name. executorch-examples-mv2 is a bit confusing

mergennachin · 2025-07-18T13:58:06Z

program-data-separation/cpp/CMakeLists.txt

@@ -0,0 +1,45 @@
+
+cmake_minimum_required(VERSION 3.18 FATAL_ERROR)


We might need to update to 3.29 now

mergennachin · 2025-07-18T13:58:15Z

program-data-separation/cpp/CMakeLists.txt

@@ -0,0 +1,45 @@
+
+cmake_minimum_required(VERSION 3.18 FATAL_ERROR)
+project(executorch_mv2_demo CXX)


use different project name

mergennachin · 2025-07-18T13:59:29Z

.gitmodules

@@ -2,3 +2,8 @@
 	path = mv2/cpp/executorch
 	url = https://github.com/pytorch/executorch.git
 	branch = release/0.6
+
+[submodule "program-data-separation/cpp/executorch"]


yeah, eventually we could just have a common submodule directory

mergennachin · 2025-07-18T13:59:46Z

.gitmodules

+[submodule "program-data-separation/cpp/executorch"]
+	path = program-data-separation/cpp/executorch
+	url = https://github.com/pytorch/executorch.git
+	branch = main


we have 'release/0.7' branch, so it should just work

only pip install executorch==0.7.0 will not work for the time being

mergennachin · 2025-07-18T14:01:09Z

program-data-separation/cpp/main.cpp

+  const char *data_path = FLAGS_data_path.c_str();
+
+  // Load the model.
+  Module module(model_path, data_path);


@shoumikhin , @kirklandsign

do we have support for swift and java bindings?

mergennachin · 2025-07-18T14:06:21Z

program-data-separation/cpp/main.cpp

+ * LICENSE file in the root directory of this source tree.
+ */
+
+#include <executorch/extension/module/module.h>


Do we need to update this doc?

https://docs.pytorch.org/executorch/main/extension-module.html

mergennachin · 2025-07-18T14:07:38Z

program-data-separation/export.py

+    with open(pte_file, "wb") as fp:
+        executorch_program.write_to_file(fp)
+    if executorch_program._tensor_data.get("_default_external_constant"):
+        executorch_program._tensor_data[model_name] = (
+            executorch_program._tensor_data.pop("_default_external_constant")
+        )
+    executorch_program.write_tensor_data_to_file(args.outdir)


where are these AOT APIs document?

should we update this doc too?

https://docs.pytorch.org/executorch/main/using-executorch-export.html

mergennachin · 2025-07-18T14:08:45Z

.gitmodules

@@ -2,3 +2,8 @@
 	path = mv2/cpp/executorch
 	url = https://github.com/pytorch/executorch.git
 	branch = release/0.6
+
+[submodule "program-data-separation/cpp/executorch"]


for now, don't worry about it

meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Jul 17, 2025

lucylq force-pushed the lfq.program-data-separation-example branch 6 times, most recently from 11059f6 to bd2e5c2 Compare July 17, 2025 21:43

lucylq commented Jul 17, 2025

View reviewed changes

lucylq marked this pull request as ready for review July 17, 2025 21:43

lucylq requested a review from mergennachin July 17, 2025 21:44

program-data-separation demo

588ae93

lucylq force-pushed the lfq.program-data-separation-example branch from bd2e5c2 to 588ae93 Compare July 17, 2025 21:49

mergennachin reviewed Jul 18, 2025

View reviewed changes

		# Program Data Separation Examples

		This directory provides an example of the Program Data Separation APIs in ExecuTorch.

		@@ -0,0 +1,45 @@

		cmake_minimum_required(VERSION 3.18 FATAL_ERROR)

		@@ -0,0 +1,45 @@

		cmake_minimum_required(VERSION 3.18 FATAL_ERROR)
		project(executorch_mv2_demo CXX)

program-data-separation demo #42

Are you sure you want to change the base?

program-data-separation demo #42

Uh oh!

Conversation

lucylq commented Jul 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

lucylq Jul 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mergennachin left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

lucylq commented Jul 17, 2025 •

edited

Loading

lucylq Jul 17, 2025 •

edited

Loading